A Deep Reinforcement Learning-Based Charging Scheduling Approach with Augmented Lagrangian for Electric Vehicle

This paper addresses the problem of optimizing charging/discharging schedules of electric vehicles (EVs) when participate in demand response (DR). As there exist uncertainties in EVs' remaining energy, arrival and departure time, and future electricity prices, it is quite difficult to make charging decisions to minimize charging cost while guarantee that the EV's battery state-of-the-charge (SOC) is within certain range. To handle with this dilemma, this paper formulates the EV charging scheduling problem as a constrained Markov decision process (CMDP). By synergistically combining the augmented Lagrangian method and soft actor critic algorithm, a novel safe off-policy reinforcement learning (RL) approach is proposed in this paper to solve the CMDP. The actor network is updated in a policy gradient manner with the Lagrangian value function. A double-critics network is adopted to synchronously estimate the action-value function to avoid overestimation bias. The proposed algorithm does not require strong convexity guarantee of examined problems and is sample efficient. Comprehensive numerical experiments with real-world electricity price demonstrate that our proposed algorithm can achieve high solution optimality and constraints compliance

Multi-AUV Cooperative Target Hunting based on Improved Potential Field in a Surface-Water Environment

In this paper, target hunting aims to detect target and surround the detected target in a surface-water using Multiple Autonomous Underwater Vehicles (multi-AUV) in a given area. The main challenge in multi-AUV target hunting is the design of AUV\u27s motion path and coordination mechanism. To conduct the cooperative target hunting by multi-AUV in a surface-water environment, an integrated algorithm based on improved potential field (IPF) is proposed. First, a potential field function is established according to the information of the surface-water environment. Then, the dispersion degree, the homodromous degree, and district-difference degree are introduced to increase the cooperation of the multi-AUV system. Finally, the target hunting is solved by embedding the three kinds of degree into the potential field function. The simulation results show that the proposed approach is applicable and feasible for multi-AUV cooperative target hunting

Blue Phosphorene Oxide: Strain-tunable Quantum Phase Transitions and Novel 2D Emergent Fermions

Tunable quantum phase transitions and novel emergent fermions in solid state materials are fascinating subjects of research. Here, we propose a new stable two-dimensional (2D) material, the blue phosphorene oxide (BPO), which exhibits both. Based on first-principles calculations, we show that its equilibrium state is a narrow-bandgap semiconductor with three bands at low energy. Remarkably, a moderate strain can drive a semiconductor-to-semimetal quantum phase transition in BPO. At the critical transition point, the three bands cross at a single point at Fermi level, around which the quasiparticles are a novel type of 2D pseudospin-1 fermions. Going beyond the transition, the system becomes a symmetry-protected semimetal, for which the conduction and valence bands touch quadratically at a single Fermi point that is protected by symmetry, and the low-energy quasiparticles become another novel type of 2D double Weyl fermions. We construct effective models characterizing the phase transition and these novel emergent fermions, and we point out several exotic effects, including super Klein tunneling, supercollimation, and universal optical absorbance. Our result reveals BPO as an intriguing platform for the exploration of fundamental properties of quantum phase transitions and novel emergent fermions, and also suggests its great potential in nanoscale device applications.Comment: 23 pages, 5 figure

The Proteasome Is a Molecular Target of Environmental Toxic Organotins

BACKGROUND: Because of the vital importance of the proteasome pathway, chemicals affecting proteasome activity could disrupt essential cellular processes. Although the toxicity of organotins to both invertebrates and vertebrates is well known, the essential cellular target of organotins has not been well identified. We hypothesize that the proteasome is a molecular target of environmental toxic organotins. OBJECTIVES: Our goal was to test the above hypothesis by investigating whether organotins could inhibit the activity of purified and cellular proteasomes and, if so, the involved molecular mechanisms and downstream, events. RESULTS: We found that some toxic organotins [e.g., triphenyltin (TPT)] can potently and preferentially inhibit the chymotrypsin-like activity of purified 20S proteasomes and human breast cancer cellular 26S proteasomes. Direct binding of tin atoms to cellular proteasomes is responsible for the observed irreversible inhibition. Inhibition of cellular proteasomes by TPT in several human cell lines results in the accumulation of ubiquitinated proteins and natural proteasome target proteins, accompanied by induction of cell death. CONCLUSIONS: The proteasome is one of the molecular targets of environmental toxic organotins in human cells, and proteasome inhibition by organotins contributes to their cellular toxicity

Broad-Wavevector Spin Pumping of Flat-Band Magnons

We report the experimental observation of large spin pumping signals in YIG/Pt system driven by broad-wavevector spin-wave spin current. 280 nm-wide microwave inductive antennas offer broad-wavevector excitation which, in combination with quasi-flatband of YIG, allows a large number of magnons to participate in spin pumping at a given frequency. Through comparison with ferromagnetic resonance spin pumping, we attribute the enhancement of the spin current to the multichromatic magnons. The high efficiency of spin current generation enables us to uncover nontrivial propagating properties in ultra-low power regions. Additionally, our study achieves the spatially separated detection of magnons, allowing the direct extraction of the decay length. The synergistic combination of the capability of broad-wavevector excitation, enhanced voltage signals, and nonlocal detection provides a new avenue for the electrical exploration of spin waves dynamics

Electronic and magnetic properties of multishell Co nanowires coated with Cu

The structural, electronic, and magnetic properties of ultrathin Cu-coated Co nanowires have been studied by using empirical genetic algorithm simulations and a tight-binding $spd$ model Hamiltonian in the unrestricted Hartree-Hock approximation. For some specific stoichiometric compositions, Cu atoms occupy the surface, while Co atoms prefer to stay in the interior, forming the perfect coated multishell structures. The outer Cu layers lead to substantial variations of the magnetic moment of interior Co atoms, depending on the structure and thickness of Cu layers. In particular, single Co atom row in the center of nanowire is found to be nonmagnetic when coated with two Cu layers. All the other Co nanowires in the coated Cu shell are still magnetic but the magnetic moments are reduced as compared with Co nanowires without Cu coating. The interaction between Cu and Co atoms induces nonzero magnetic moment for Cu atoms.Comment: 7 pages, 2 fugure